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Introduction 



The Search for Solutions (SFS) series has been a popular and important 
component of many school science programs ranging from elementary to college 
level. Phillips Petroleum Corporation, funding agent for the SFS, reported 
that by 1984 some 26,000 schools, 83 percent of all public and private schools, 
have used the series. In addition, some 84 million students had viewed the 
films prior to January, 1984. The continued popularity of the SFS series 
attests to its perceived effectiveness on the part of teachers. However, it is 
not clear just what effects on students, both in terms of achievement and 
attitudes, result from the series. In addition, over the years many strategies 
have been developed by teachers to utilize this series. This evaluation 
endeavor was to assess teacher perceptions resulting from the use of the 
"Search" series and to further determine various instructional strategies and 
their effectiveness. 



Background 

The series was developed to pique interest in science and middle school 
students. Secondly, it was designed to encourage new questions on the part of 
students. The specific aims were to present science as a study of processes, 
take a look at failures in science, develop the idea that scientists are 
persistent, illustrate the joy of discovery, foster an interest in lifelong 
learning of science, and develop problem solving skills. These objectives are 
indeed worthwhile, but have they been met? The purpose of this study is to 
answer that question. In addition, teachers have the ability to use any 
educational program in a multitude of ways - some are effective and some are 
not. An additional purpose of this study will be to find out liow teachers use 
the "Search." 

Ames (1984) noted that the intent of the films was a response to the following 
metaphorical analogy: 

"...students are not responding to math and science instruction because 
they are not able to see how the "game" is played. They are only being 
taught the rules. Imagine not being allowed to play the game - or even 
witness the play. Under such conditions even the most devoted fans 
would lose interest (Ames, 1984, p. 15)." 

The nine documentary-style films focus on a variety of scientific concepts. 
The seri<^s takes a global look at the everyday experiences as it follows 
scientists, statesmen, and others who have tackled science or science-related 
problems. Program titles are "Investigation", "Evidence", "Patterns", 
"Adaptation", "Context", "Trial and Error", "Modeling", "Theory", and 
"Prediction". 
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SURVEY DEVELOPMENT AND ADMINISTRATION 



The Search for Solutions Survey (SSS) was developed consistent with the goals 
of the Search program development. A copy of the survey is provided in 
Appendix A. The survey is composed of. five parts and a demographic 
questionnaire. Part I assessed the use of the films and teachers* guide* Part 
II assessed the impact of the films on students within the context of the 
developers objectives. Part III was concerned with the success of the films in 
terms of reaching the goals of the developer. Part IV was a series of open- 
ended questions. Part V provided an opportunity for teachers to record 
frequency of use, quality of production, and appropriateness by each film 
title. 

The SSS was field tested by sending it to ten middle school teachers. Comments 
and criticisms were solicited and revisions were made. In addition, the ten 
field testers were asked to respond to a content validity instrument regarding 
clarity, understanding, relevance, and representativeness of the items. These 
judges rated the items with 91? agreement. 



A stratified random sample of middle school science teachers was obtained from 
the SFS film distributor. Surveys were sent to 728 search users. The sample 
was broken down by state and user type. User types were regular users, 
occasional users, new users, and restart users. Three-hundred-sixty-four 
surveys were returned. 



Quantit ative Results 

Data collected from the teachers concerning the SFS filns revealed a great deal 
of information regarding the demographics of the teachers in general. 
Approximately 13? of the teachers responding to the survey were in their first 
five years of teaching, while nearly 27? had taught for more than 20 years. 
Interestingly though, the model group for teacher ages was 31-40 years. 
Another 33? of the teachers responding in the sample were between 41 and 50 
years of age. 

Most of the teachers, 60?, reported more than 40 hours of academic course work 
beyond the bachelor's degree. This figure would tend to indicate that most of 
the teachers have completed master's degrees. Over two-thirds of the sample 
respondents were men. 

A large percentage, 44?, of the teachers reported that their major teaching 
responsibility was in the area of the life sciences. The physical sciences 
were reported as a major teaching responsibility by an additional 30? of the 
respondents. Approximately two-thirds of the respondents also reported that 
they do not teach courses other than science. The above information is shown 
in Table 1. In addition, this table shows the number of years that the SFS 
films have been used, the type of classes in which the films are being used, 
and the number of films used by the respondents. 
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Information was also collected regarding the type of use for the SFS films. 
Most teachers reported that they "frequently" used the films to "provide 
general scientific information." There was not a clear pattern from the 
teacher responses as to when the films were used in the teaching of given 
information. Most of the respondents reported using the films to both 
introduce and to summarize lessons on a "frequent" basis. For the most part, 
the films were only used once with a given class and their main function was 
"enrichment" of the lesson. 

Teachers were generally in agreement that the films were successful in having 
an impact on students. There was, for instance, general strong agreement that 
the material in the films war presented in an interesting manner, was valuable 
for the students, and that the students liked the films. Respondents were less 
certain that the films made students want to study science more or that the 
films fostered an interest in science careers. This information is presented 
in Table 3. 

With regard to the goals of the films, respondents were in agreement that the 
films showed that science is a study of processes, that success and failure are 
a part of science, and that persistence is a characteristic of scientists. 
This information is shown in Table 4. Finally, the teachers were asked to rate 
the Search fo r Solution^ films. The ratings showed only a remarkable degree of 
similarity in the films. Trial and Error was the slight favorite .in terms of 
both quality of production and appropriateness for students when considering 
the sample means. 



Qualitative Findings 

In order to probe beyond the questions and response categories of Parts I, II, 
III, and V of the survey, five open-ended questions were developed. Although 
many respondents left one or more of these questions blank, several comments 
were held in common. Certainly, these questions allowed an opportunity for 
teachers to respond in a way that is useful to the film developers and teacher 
educators. All surveys (364) were analyzed using a content analysis procedure 
that broke down responses in to categories. These categories were scanned for 
commonality and relationships. Resultant data appears in Tables 6 through 10. 



As predicted, the SFS series was highly thought of by most middle school 
teachers. These films represent one of the more significant contributions from 
the private sector in recent time. The SFS and accompanying teacher^ s guide 
provide supplementary material for science teachers that depict the enterprise 
of science in a most realistic setting. It. is critical for students and 
teachers to observe science in action as a tentative, exciting, and rewarding 
process since many students may rarely have the opportunity to observe or 
participate in "real" science. 
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TABLE 1 
Data Tables: Search 



■for Solutions Survey 



Years o-f Teaching 
Experience <n«348) 

1 - 5 Years 
6-10 Years 
11 - 15 Years 
16-20 Years 
> 20 Years- 



Age <n=346) 

21 - 30 Years 
31 - 40 Years 
41 - 3C Years 
51 - 6Q Years 
> 40 Years 



FRE<;UENCY 



A6 
58 
82 
69 
93 



43 
12? 
115 
49 
iO 



Academic Background 
Bachelors Plus... <n=«344) 



PERCE^frAGE 



13.2 
16.7 
23.6 
19.8 
26.7 



12.4 
37.3 
.33.2 
14.2 
2.9 



CUMULATIVE PERCENTAGE 



13.2 
29.9 
53.4 
73,3 
100.0 



12.4 
49.7 
82.9 
97.1 
100.0 



0-20 Hours 
21 - 40 Hours 
41 - 60 Hours 
51 - 80 Hours 
81 - 100 Hours 
> 100 Hours 



58 
80 
85 
50 
25 
46 



16.9 
23.3 
24.7 
14.5 
7.3 
13.4 



16.9 
40.1 
64.8 
79.4 
86.6 
100.0 



Gender <n=«345) 

Female 
Male 



110 
235 



Primary Teaching 
Responsibl i ty 
<> 50% o-f classes) <n=337) 



31.9 
68.1 



31 .9 
100.0 



Li-fe Science 
Physical Science 
Earth Science 
Other 



149 
101 
45 
45 



44.2 
30.0 

13.4 
12.5 



44.2 
74.2 
87.5 
100.0 



ERIC 



TABLE 1 (continued) 



FREQUENCY 

Do You. Teach Courses 
Other Than Science <n=344) 



No 223 
Yes 123 



Years Using SFS <n='344) 

0 - 1 Years 109 

2-3 Years 69 

4-5 Years 104 

> 5 Years 64 ' 



Type of Clas«i 
Shotwn SPS <n=339) 

Regular Classes 310 
Remedial Classes . 9 
Accelerated Classes 20 



Number o-f Films 
Used <n«348) 

■1 to 3 Titles 40 
4 to 6 Titles 73 
7 to piTitles ■ 235 



PERCENTAGE CUMULATIUE PERCENTAGE 



64.5 64.5 
35.5 • 100.0 



31.5 31.5 

19.9 51.4 

30.1 81.5 

18.5 100.0 



91.5 91.5 

2.7 94.2 

5.8 100.0 



11.5 11.5 
21.0 32.5 
67.5 100.0 
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TABLE 2 



Use of Search -for Solutions Films 



• • 

Used Films to Introduce 


FREQUENCY 


PERCENTAGE 


CUMULATIVE PERCENTAGE 


riCXivi^ies Ku^-qH/} 




• 




Frequently 


44 . 


12.6 


12.6 


Sometimes 


■ 213 


61.2 


73.9 


Never 


90 


26.1 


ido.o 


Used Fi 1ms to Sum Up 








Lessons <n=348) 








Frequently 


29 


8.3 


8.3 


Sometimes 


224 


64.4 


72.7 


Never 


95 


27.3 


100.0 


Used Films to Provide 








General ScientifiG 








inTOrinax 1 on sn^ts'to/ 








Frequently 


249 


71.6 


71.6 


Sonietimes 


93 


26.7 


98.3 


Never 


6 


1.7 


100.0 


Used the Teacher 








Guide <n=348) 








With all the films 


105 


30.2 


30.2 


With one or more films 


187 


53.7 


83.9 


Without th-- films 


2 


0.6 


84.5 


Did not use teacher guide 


54 


15.5 


100.0 


Frequency of Film Use <n*348) 






Once per class' 


295 


■ 84.8 . 


84.8 


.One or more films more 








than once 


44 


12.6 


97.4 


All the films more 








than once 


9 


2.6 


100.0 
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TABLE 2 (continued) 



Use o-f Films <n=347) 

Enrichment 295 84.6 ' 84.8 

Planned part o-f lessons 52 15,2 100.0 



Do you have your mn • 

copy? <n»348) 

Yes 49 19.8 19.8 

No 279 80.2 100.0 
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TABLE 3 

Search for Solution Impact on Students 



Items . ' X SD N 



These films had a positive affect on my 

students' attitudes toward science. 4.17 ,712 



347 



After viewing these films my students 

wanted to study science more. 3,48 .694 347 
I feel the content of these films is 

valuable for my students. 4.43 .^33 347 
The material in these films is presented 

in an interes.ting way. 4.54 ^^16 346 

After viewing these films, students have a 
better understanding that the knowle'd&e of 
science -is constantly changing and not 

absolute. 4.25 .621 346 

Students expressed an interest in science 

after viywing these films. 3. 71 .779 34^ 

The films illustra-te the joy of discovery in 

science. . 4.27 .638 346 

The students liked these films. 4.30 .660 346 

These fiUms fostered an interest in 

-sc4»nce as a- canetr <in ray students). 3-.4-I -1714 -346- 



9 



ERIC 



11 



TABLE 4 

Degree Search -for Solutions Goals Met 



Iteraf> • X SD N 

. 

To Increase student interest in science: 
Increased a 5 4 3 2 1 Did not increase 

great deal at all 2.66 .791 346 

To encourage students to ask questions; 
Encouraged 5 4 3 2 1. Encouraged few 

many questions questions 3.80 .863 346 

To present science as study of processes: 
Clearly ^ 4 3 2 1 Not clearly 

presented presented 4.18 .766 346 

To develop problem solving skills in students: 
Developed 5 4 3 2 1 Developed 

ver/ well poorly 3.77 .826 346 

To show both success and failure as part of science: 

Shows very 5 4 3 2 1 Shows 

well poorly 4.09 .806 346 

« 

To develop persistance as a characteristic of 
scientis'.s: 

Jeveloped 5 4 3 2 1 Developec 

very well poorly .4.11 .792 346 
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TABLE 5 

Teacher Ratings of Search for Solutions 



• 


QUALITY OF 


PRODUCTION • 


APPROPRIATENESS FOR 


STUDENTS 


• 

pILn TITLt 


X 


• 

SD 


X 


SD 


Prediction <N=295) 


4.49 


.633 


4.22 


.757 


Mode lino <N=290) 


4.46 


.660 


4.22 


.779 


Theory <Nss290) 


4.46 


.670 


4.16 


.766 


Evidence <N=:293) 


4.50 


.634 


4.25 


.801 


Patterns <N=283) 


4.41 


.726 


4. IS 


.809 


Investigation <Nss284) 


4.48 


.637 


4.25 


.733 


Adaptation <N=277) 


4.43 


.665 


4.18 


.754 


Trial & Error <N=282) 


4.53 


.638 


4.32 


.749 


Context <N=!266) 

• • 


4.40 


.667 


4.11 


.802 



5 =« Very Good 4 = Good 3 = Undecided 2 » Poor 1 « Very Poor 



TABLE 6 



Why did you being using the Search for Solutions films? 

Number of 



Most Frequent Comments Responses 

Influence from another teacher 50 

Saw advertising about them 40 

They are free 31 

Enrichment 24 

Films show science process 20 

Previewed films and liked them 10 



Other Comments 

* Really liked the way science was applied to modern day Technology to 
Frisbees, Dallas Cowboys, air sculptures, etc. 

* General introduction to science, scientific Investigation, and methods 

* Introduces various aspects of science 

* Lab thinking 

* Had seen parts on television 

* Love the book. • .presented a visual for nine facets of science not 
previously available 

* Trying to locate films to use to illustrate many areas of General Science 



TABLE 7 

Flow did you originally find out about the Search for Solutions films? 

Number of 

Most Frequent Comments Responses 
Advertising 202 
Another teacher 89 
Previewed film 15 

12 
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TABLE 8 






What do you see to be Search for Solutions ma.ior value for students? 


Most Freoujnt Comments 


Number of 
ResDonses 


Show process of science 


72 


Motivational y create interest toward science 


58 


Shows diversity of science, different scientific examples 


46 


Enrichment 


25 


Emphasizing scientific method 


21 


Helps students understand how science works 


17 


Shows different careers in science 


15 

• 


Other ResDonses 






Blend of Art, History, Science, and Inventiveness 






Promote substantive discussion 






Science is not absolute 






Shows discoveries are not always made in laboratories 






Shows there are successes and failures 






Through failures discoveries can be made 






Different approach than our book 






To reinforce my lessons 




« 


Solutions don't come easy 




t 


Shows how to solve problems in everyday life 




ft 


Shows joy and interest of scientists 




t 


Intellectual curiosity bears fruit 

13 
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TABLE 9 

How might Search for Solutions films be improved by revision? 

" Number of 



Most Frequent Comments Responses 

Improve dialogue and vocal quality 23 

Adjust vocabulary and subject to grad« level 21 

Provide examples of more recent research 16 

Make film*' on same subject matter 16 

Less narration and more action 11 

Provide more subject matter (deeper) 9 

Need better teacher *s guide 8 

Provide better* scene continuity 6 

Different and more appropriate music 6 

Need more geology and earth science ' 3 



Other Responses 

* Increased emphasis on environment 

* More hands-on activities 

* One film per month 

* Improve associated activities 

* More emphasis on life sciences 

* More emphasis on scientific methods 

* Students do-at-home projects should be included 

* Incorporated ethical issues 

* Films on unsolved problems 

* Include biographical information with film 

* Include test v/ith films 

14 
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TABLE 10 



Further comments concerning the Search for Solutions films: 



Most FrsQ uent Comments 



Number of 
Responses 



Need to be updated 



32 



Want to copy films 



9 



Other Responses 

* Fails to interest AP students 

* Should include more material on Geology and Earth Science 

* Shows science is universal 

* A list of pre and post true/false questions with teachers guide 

* Prefer 16 mm - shows larger picture 

* Too advanced for middle school 

* Wish there were teacher workshops in conjunction with films 

* The Newsletter is helpful 

* Emphasis green leaves, recyclable non-polluting energy sources; not nuclear 
waste problems 
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PART l< 



For the first eight <8> statements, you need only tonrlte the letter in the blank In tin 
right margin t'tat corresponds to the answer most accurately dtacrlbing you. 



0 n 



1. The«number of films I used In the Search serlesi |.. 

A> 1 to 3 fllr. titles 
S> 4 to 4 flto titles 
C> r to f film titles 

2. 8 used the films to Introduce lessons or actlvltleoi 2.. 

A> frequently 

8) ifoattines 
C> never 

3. 1 uoed Ihe films' to sum np lessons or actlvltlesi 3.^ 

A> frequently 
i> Sf3la#tlmee 
C> eev^r 

4. 1 used the films to provide gtncral scientific Inforaatloni 4.. 

A> froquantlx • 
8> sometimes 
C> never 

i» I used the teacher guldei 9«. 
A> with all the films 

i> with one or more of the films <but not all) 

0 without any of the films 

D> did not use the teacher guide at all 

4* Frequsncr of film usei 4.^ 

M use each film only once per class 
B> use one or more films mere than once per 
classt but not all the films 
' 0 use cll the films more than once per class 

7* I used these films asi 7.^ 

M enrichment not a substantive part of the planned 

leofons or course 
8> an Integral t planned part of my lessons 

3e How that It Is lefisl to maKe copies of these 
vidtosf do you have your own copies <or does 
the school have Its own copies)? tf yett how many? 

A> yen 
6> no 




litM cartfiilly riad lach of Ihi foltaiiM.ttitmiitt. At yiM do tO| txpritt thi cxtsM 
f y««r agriMtRl with lach sCiltMRl by cIrcllMO tni of tht littirt (Im thi rl^t 
iffl«> lAlcli Mai nearly ditcrlb«s mr protmt iit» of tht litrcli lor Sottttlens lilst 
ir(ttt man Mrllt Ihi Itlter rM eirclarf Im tilt Manic tpact at lha right aarglMt 
laatv iifla tka folloniaQ tcnlti 

A « St.rfwal)^ 
i " Agrat 

C • Hantral/UaikclCtca 
D » OltaBrat 
C • Itrongly Dltagrta 



FART lit. 



^ TMta II Im M a potltlvt alltct en «y A i C 0 f 

stttdtntt^ attltadat tmard telancot 

I* Af taf vltMlng tiiata lilM^ my ttgtfaatg A t C » B 

' MM^i to tUdy iclencft norat 

• I lati tlia ccMitant ol thata lllmt It valtablo A 8 C 0 i 
Itr air tttdtnts* 

Mfct aiattrlal |g thata lllat It prattteatf In tn A • C 0 8 
. lattratting way* 

Altar vltwlng thata Hint, tttdentt havt o A • C ^ E 

iMttar uniltrttancllng that tha imaMladgt g| 
tclaKt It coAttajitly changing and not abtQltttt 

!• ttgdtntt axpratsatf tn Intaraat in tclanet altar A 8 C 0 I 
vltnlng tiiata IIIm* 

• tfct Hint llltttratt lha Joy ol tfltcovary In A 8 C D 6 
tclanet* 

• Iku tttdtntt llftad thata liliat* A 8 G D 8 

• Tktta llfHit lottaratf an intaratt in tclanca at A 8 C 0 C 
n caraar (In my tttdtott)* 



18*. 
II*. 
12*. 
13*. 

14*^ 
I8.« 

17*^ 



Tharf M^M tavaral goaia and purpotat that lottarad the devalop»ant ol l^a 3earch 
J^^ltilflfli llira tarlat* Littad below are thete goalt and pSrpM.r wMh^^S^ 
ieel!^? ^'r^*^* regarding the degree to'i^lch thete%o^r«d p!r|.0M?S?J 

•eeonplithed* Heate place the appropriate rttpontt for each Item In :haTCk tg^M 



ntttttt^ntftonttna 
18* 7o increate ttttcStnt interttt in eclencti 



l»crttted a 
great deal 



9 4 3 2 1 



Old not locreaee 
at all 



19. To encourage tlvdentt to atk quettionti 



Cftco^ragtd 
leany ^ttattioyit 



8^321 Incouraged 
lew ^uettiont 



2t* To prettnt tclence at tttdy ol procetteoi 
9 4 3 2 1 



Clearly 
pretentKd 



Not clearly 
presented 



2SI* To dfwelop probleM tolving ^Clllt in otodentti 
9 4 3 2 1 



Developed 
very well 



Developed 
poorly 



22* To thm botfe ttecett and lallvrt at par^ ol tcioncei 



ShDwt very 
welt 



8 4 3 2 1 



Shows 
poorly 



23* To' develop pertlttenct at a charactcrittic ol tclentltttt 
9 4 3 2 1 



18. 



19. 



2Q. 



21. 



22. 



23* 



00 



Davolc^ed 
very i;all 



Developed 
poorly 




f 



^•••!L•!!r/A•!^!^J^^^^^^ H PIMM r.U Mcfc ol^tUt n..rcH 4^ «.i.Hn,, IHM I. lotlclnB 9rld ..|.g 



m tttdAort tMct tbM It iirovldfdt yoi a«r coatlRist on tht buk of this mm of 

incliedt «ddlUoiiftl tUtttt. 



•t0tof»att«o«fffft 

M. Wfcy did y«i biQlM utiiig Ih* Mircii 4«y •o^^tiyfly |||*t7 



rfprftiMI«9 your ojlnlon. PUttt utt tUt lolloKlto tetit lor Iht •Ti 3 at- | m 
both col vans 12 tnd I3t 

5 • ^/iry «ood 4 • food 3 • Undtcidtd 2 • Poor I Vtry foor 



MTIHI Of EACH FILN 



29. NoM did yoa orlgln«lfy find ool tboMl Ut tttreb for fotiilffy^i «iii»«9 


_ FJIbTUI. 


1 Nunbsr of 
1 tints ufltd 

J.<tfioroxtiittt) 


1 Qutllly of 1 Afpropritttnttt t 
1 prodyctloo 1 for my ttudtntt 1 
I 5 4 3 2 1 1 9 4 3 2 1 ) 




• 

Prfidlctlon 




( 1 1 
1 1 i 
I f 1 


II. Mat do yon ttt to bt fttrcb 4or SoIhIIm^ ' ..Iap 
your olttdtiitfl? « 


Hocrtlliig 




1 i 1 
1 i 

[ i 1 


Tbtory 




1 1 
1 1 

i i 


• ■ 


fvldfRCt 




1 i 
1 1 


i;. Hon aloht tht litrch for iotylloiii siim^ hm t^^^miA yj^ 






» i 


iNrt tbit to riviat thin? 






1 1 
1 1 
i i 




Uvtstlenllon. 




i 1 
1 1 
1 1 


n. rittit Mkt My furtliir conneitt yo* mmM lIRt cMciralna tkt 
ttueh «oMo)«tli>fli «ii 


Adtntttlod 




1 1 
1 1 
1 1 




Trfel t Srrcr 




1 i 

i i 
1 1 




Coottxt 




1 i 
1 1 
1 1 



f ^1 



